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Abstract 

NetEvo is a computational framework designed to help understand the evolution of dy- 
namical complex networks. It provides flexible tools for the simulation of dynamical pro- 
cesses on networks and methods for the evolution of underlying topological structures. The 
concept of a supervisor is used to bring together both these aspects in a coherent way. It is the 
job of the supervisor to rewire the network topology and alter model parameters such that a 
user specified performance measure is minimised. This performance measure can make use 
of current topological information and simulated dynamical output from the system. Such an 
abstraction provides a suitable basis in which to study many outstanding questions related 
to complex system design and evolution. 
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1 Introduction 

This report does not present any scientific results but instead gives an overview of a new com- 
putational framework called NetEvo. It is the aim of this tool to provide a coherent approach 
for the study of complex systems that can be described using dynamical networks and which 
change over time due to some evolutionary process. This document introduces the functionality 
of the framework, gives an overview of the technical architecture, presents an example of its use 
and describes future directions for the work. Due to the framework being under continual de- 
velopment we do not discuss specific implementation details that are likely to change. Instead, 
we direct you to the project website |http : / /www, netevo . org| where additional information 
can be found. 

1.1 Motivation 

Network science has seen much interest over recent years with it providing many tools for the 
analysis of complex systems. During this time several characteristics have been shown to be 
shared by systems across domains, including scale-free degree distributions [1 j and small-world 
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type properties [2]. More recently, an increased focus has been placed on dynamical processes 
that take place on such topologies; with a key example being the modelling of epidemics such 
as SARS and Swine flu [|Q. Furthermore, generative models have been developed to understand 
the driving forces that underlie network creation [1]. 

In contrast, relatively little effort has been made in attempting to understanding how struc- 
tural, dynamical and evolutionary features are pieced together within a complex system. NetEvo 
has been developed to help meet this need. It aims to provide a computational foundation on 
which to investigate how these various aspects are linked and ultimately provide a more com- 
plete view of complex systems in general. 

1.2 Development 

The NetEvo framework is fully open-source software released under the Open Source Initiative 
(OSI) approved MIT license. This gives end-users the greatest flexibility in using and extending 
the code for their own requirements, important in research based projects. To allow for collab- 
orative development all source code, documentation and management information is hosted by 
Sourceforge - |http : //sourcef orge . net| This is an online facility used by many open-source 
projects to allow for developers to productively work together, handling day-to-day manage- 
ment of underlying infrastructure. We see NetEvo as a collaborative effort and welcome any 
additional help or support from others in the complex systems community. 

2 Functionality 

NetEvo performs two main functions; simulation and evolution of dynamical networks. In order 
for this to be tailored towards a specific problem it is necessary for an end-user to provide: 

1. A set of component dynamics for nodes and edges, 

2. An initial network topology for the system, 

3. The evolutionary process that searches for improved configurations, 

4. A performance measure Q to be used as a guide during evolution. 

Several standard types have been included for each of these categories, such as Rosller oscil- 
lator dynamics, a rewiring evolutionary process and a synchronisability performance measure 
(eigenratio). 

To bring together simulation and evolution in a coherent way, the framework uses the idea 
of a supervisor, illustrated in Fig.JT] Simulation is carried out by taking the component dynamics 
and network topology, and then numerically solving the system for a specified period of time. 
The solvers are a central part of NetEvo and are initially focused on systems that can be described 
using ordinary differential equations (ODEs). 

Evolution of the system is performed by the supervisor which can be viewed as a form of 
optimiser. This takes as input an initial topology, simulated output from the system and user 
defined constraints, and aims to return an optimal or enhanced topology and parameter set. 
Changes to the system are assessed by using the performance measure Q, with smaller values 
representing an improved performance. 

With many possible applications containing differing dynamics and constraints, it is impos- 
sible to develop a single supervisor that will work well in all situations. Instead, by default we 
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Figure 1: Flow diagram of a supervised network. The dynamical network is represented by the 
node / edge dynamics and network topology while the evolutionary process is embodied in the super- 
visor. Q represents a performance measure that the evolving network attempts to minimise. 



provide a supervisor that uses a simulated annealing meta-heruistic to search for near optimal con- 
figurations. This method has been shown to perform well for a wide range of problems with an 
unknown prior structure. We allow for many aspects to be customised including cooling sched- 
ule, accepting probability and halting criteria. Users are not, however, limited to only using this 
method. As with all of NetEvo if an alternative evolutionary process is required, possibly due to 
the way some physical process works, it is possible to define custom supervisors that make use 
of any other build-in modules. The ability to piece together various modules for a specific need 
is important in allowing NetEvo to be widely used. 

In addition to these core features, the framework also provides a standardised file format for 
the description of dynamical networks. This is based on GraphML and uses attributes to hold 
dynamical information about various components making up the graph. With GraphML being 
a widely used format to exchange graph data, output from NetEvo can immediately be used by 
a wealth of other tools. 



3 Architecture 

The design of the framework has revolved around two main aims: efficiency and simplicity. These 
were important because firstly the computational effort required when simulating and evolving 
networks is large, and if we wish to investigate real-world systems in a feasible time the im- 
plementation needs to be fast. Secondly, to reduce the learning curve for end-user, developing 
simple well documented interfaces is vital. 



3.1 Internal Design 

NetEvo has been developed solely in the C programming language due to its high performance, 
extensive collection of libraries, direct access key technologies (MPI, OpenMP and OpenCL) and 
portability across all main operating systems and computer architectures. To allow for the logical 
separation of components and the possible replacement of functionality based on user require- 
ments, a modular and layered architecture has been adopted (see Fig. [2]). 

A set of core modules implement the fundamental features of the framework, managing the 
underlying data types. On top of these, interface modules act as an intermediary to end-users, 
exposing the various features they can directly access. Furthermore, each individual module is 
compartmentalised such that alternative implementations can be provided where appropriate. 
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Figure 2: Overview of the main NetEvo modules. Core layer functionality is represented by the lightly 
shaded modules, while the interface layer is highlighted by the darker modules. 



This becomes important when development of a program takes place on one type of architec- 
ture, and execution on another, e.g. development on a single processor desktop computer and 
execution on a multi-processor computing cluster. Under these scenarios, the framework can be 
used with optimised modules for the respective systems and the user need not worry about the 
final running environment during development. 

3.2 External Dependancies 

In order to make best use of existing code and maximise the available functionality when using 
NetEvo, two external libraries have been directly incorporated into the core of the framework: 
igraph and the GNU Scientific Library (GSL). These were chosen due to the large functionality they 
provide, their code maturity and for being highly portable across computing architectures. 

3.2.1 igraph 

The igraph toolkit (H provides efficient data types with which to implement graph based algo- 
rithms for use on large data sets. The toolkit initially focused on performance, however, more re- 
cently features have diversified into areas such as community detection, visualisation and spec- 
tral analysis. Due to computational efficiency being an important factor during the design of 
NetEvo, igraph was selected as the internal data type for network topologies. If alternative for- 
mats are required, a wide range of common export functions are available to allow for external 
analysis. 

3.2.2 GNU Scientific Library (GSL) 

To provide access to a large number of numerical methods including the solving of ordinary 
differential equations, spectral analysis and linear algebra, the GNU Scientific Library (GSL) [5| 
is used. Due to this library requiring GSL based data types for the input to many functions, 
methods have been included within NetEvo to perform necessary conversion from structural 
and dynamical output. 

4 An Example 

To help illustrate the framework in action we will now present a simple example of enhancing 
the synchronisability of a dynamical network. To allow for our results to be comparable to those 
in the literature, we consider nodes having Rossler dynamics, diffuse edge coupling and impose 
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a fixed number of nodes equal to 100 with a fixed degree of 4. Evolution of the system is con- 
strained to only take place through rewiring of existing edges and as a performance measure we 
chose the eigenratio which when minimised has been shown to improve the synchronisability of 
a system[6j. The eigenratio is given by 

Qer = ^, (1) 

where A at and A2 are the Nth and 2nd eigenvalues of the network Laplacian respectively. Op- 
timising networks using the eigenratio has already been carried out in the literature [7], with 
resultant networks exhibiting a reduced diameter and clustering, and increased girth. By using 
NetEvo with this same measure we aim to show that similar topological features emerge. 
In summary we configured NetEvo in the following way: 

1. Component dynamics - Rossler oscillator for nodes and diffusive edge coupling, 

2. Initial network topology - Lattice (100 nodes and 200 undirected edges), 

3. Evolutionary process - Edge rewiring using built-in simulated annealing supervisor, 

4. Performance measure - Eigenratio. 



4.1 Coding NetEvo 

Using the system description from the previous section we can now generate the code required 
to perform the network evolution. As with all programs written using NetEvo this breaks into 
five main steps: 

1. Initialisation of the framework 

2. Creation of the NetEvo system (node/ edge dynamics and initial topology) 

3. Configuration of simulation and supervisor 

4. Evolution of network through execution of the supervisor 

5. Clean-up 

The following code listing implements these steps and have been commented to help explain the 
exact tasks being performed. 

1 /* NetEvo and igraph libraries will be used */ 

2 #include <netevo/netevo . h> 

3 #include <igraph.h> 
4 

5 int main (int argc, const char * argv [ ] ) { 

6 

7 /* Define required variables */ 

8 FILE *gFile; 

9 igraph_t G; 

10 ne_dyn_t *D = NULL; 

11 ne_system_t *S = NULL; 

12 ne_sup_sa_params_t *saParams; 

13 ne_mut_t *mutFn; 

14 ne_ode_solver_conf ig_t *solverConf ig; 
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15 double mParams [NE_MAX_MUT_P ARAMS ] ; 

lb 

17 /* Initialise the framework seeding the random number generator */ 

18 ne_common_init (time (NULL) ) ; 

19 /* Configure the standard output and error logging */ 

20 ne_output_init ( "EXAMPLE" , ".txt", NE_LOG_FULL, FALSE, NULL, NULL) ; 
21 

22 /* Read in the initial network topology from file */ 

23 gFile = fopen("Lattice.txt", "r"); 

24 igraph_read_graph_gml ( &G, gFile); 

25 igraph_to_undirected (&G, IGRAPH_TO_UNDIRECTED_COLLAPSE) ; 
26 

27 /* Select the node and edge dynamics and set global coupling to 0.5 */ 

28 D = ne_dyn_alloc (SG, "Rossler3", "Dif f use3XZOnly" , FALSE, FALSE, FALSE, FALSE, 3); 

29 D->def EdgeDyn->def Params [ ] = 0.5; 

30 

31 /* Create the NetEvo system */ 

32 S = ne_system_alloc ( &G, D) ; 

33 

34 /* Define the mutation function (rewiring) */ 

35 ne_pop_array_zero (mParams, NE_MAX_MUT_P ARAMS ) ; 

36 mParams [0] = 1.0; 

37 mutFn = ne_mut_rewire_alloc (mParams ) ; 

38 

39 /* Set parameters for the ODE solver */ 

40 solverConfig = (ne_ode_solver_conf ig_t *) malloc ( sizeof (ne_ode_solver_conf ig_t )) ; 

41 solverConf ig->length = 100; 

42 solverConf ig->eps_abs = 10e-5; 

43 solverConf ig->eps_rel = 10e-5; 

44 solverConf ig->initStep = 0.0001; 

45 solverConf ig->minStep = 0; 

46 solverConf ig->f ixedStep = FALSE; 

47 solverConf ig->step = gsl_odeiv_step_rkf 45; 

48 

49 /* Set parameters for the simulated annealing supervisor */ 

50 saParams = (ne_sup_sa_params_t *) malloc ( sizeof (ne_sup_sa_params_t )) ; 

51 saParams->initialTrials = ( int ) igraph_vcount ( S->graph) ; 

52 saParams->tempReduce = 0.9; 

53 saParams->mainTrials = 5000; 

54 saParams->acceptTrials = 500; 

55 saParams->acceptRunsNoChange = 5; 

56 saParams->minTemp = 0.0000001; 

57 saParams->maxIterations = 500000; 

58 saParams->initialTempFn = &ne_sup_sa_int_temp_basic; 

59 /* Use the eigenratio performance measure */ 

60 saParams->QFn = ne_per_top_eigenratio_params_alloc (NULL) ; 

61 /* Use the rewiring mutation function (defined previously) */ 

62 saParams->mutationFn = mutFn; 

63 /* Use the previously defined ODE solver configuration */ 

64 saParams->solverConf ig = solverConfig; 

65 /* Use the standard network measures analysis function */ 

66 saParams->analysisFn = &ne_analysis_std_measures; 

67 saParams->initCond = NULL; 

68 

69 /* Run the simulated annealing supervisor to evolve the network */ 

70 ne_sup_sa_run (S, saParams); 

71 

72 /* Release any resources used by NetEvo */ 
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73 ne_output_f inalise ( ) ; 

74 ne_common_f inalise () ; 
75 

76 return 0; 

77 } 



4.2 Results 

A final topology and some standard network measures taken throughout the evolutionary pro- 
cess are shown in Figure [3] These illustrate similar features to those seen in the literature with de- 
creasing diameter and clustering, and increasing girth. Visualisation of the topology also shows 
similar characteristics to examples presented in 0, with an entangled structure that makes any 
localised structure very difficult to see. 

In summary although we have not presented any new results we have shown that NetEvo 
allows for evolutionary simulations to be created with very little effort and that the framework 
provides a flexible tool to study a wide range of problems. 



5 Future Directions 

At the time of writing, NetEvo focuses on complex networks that can be described using con- 
tinuous ordinary differential equations that are evolved using a standard simulated annealing 
meta-heuristic. Although a large number of problems can be expressed in this form, it does limit 
possible applications of the framework. The majority of future directions focus on reducing this 
limitation. 



5.1 Range of Dynamics 

A set of dynamical components are provided with NetEvo to allow for many general types of 
system to be described, e.g. gene regulatory networks (GRNs), however these are all based on 
ODE representations. Some systems are not continuous or deterministic which limits the use 
of NetEvo. A possible extension would be to provide the ability to have discrete dynamics and 
simulations that include stochastic effects. This could be performed using a stochastic master 
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Figure 3: Results from using NetEvo to evolve networks with improved synchronisability. Network visu- 
alisation was performed using Graph Viz [8 1 and an energy minimised layout. 
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equation (Gillespie algorithm) or stochastic differential equations. In addition, the ability to add 
delays would also be useful where interactions are not instantaneous, e.g. neural signalling. 

5.2 Enhanced Supervisors 

At present a built-in simulated annealing based supervisor is provided as a flexible all purpose 
method. In some cases, however, the problems being studied may have some intrinsic struc- 
ture which can be incorporated into the evolutionary processes. An interesting future direction 
would be to develop a general purpose supervisor that attempts to learn such structure and 
utilise it to favourably direct evolution of the system. This would likely involve the use of sta- 
tistical machine learning, giving an additional benefit of providing a way of extracting hidden 
structure from systems that are currently not well understood. 

5.3 High Performance Computing 

Speed is vital to allow for NetEvo to study problems in reasonable amounts of time. Multi- 
threading has been incorporated during the simulation process, which allows for better use of 
resources on multi-core systems, however, will not provide a benefit when running on high 
performance computing clusters. The benefit of multi-threading is limited to the local computing 
node. 

One possible extension would be use the Message Passing Interface (MPI) to distribute pro- 
cessing among computers in a cluster. Due to the overhead imposed by communication, such an 
approach would not be suitable for the simulation of dynamics, however, would be appropriate 
for population based supervisors (e.g. a genetic algorithm). In this case each individual in the 
population could reside on a separate compute node and be evolved in isolation during each 
iteration. 

Alternatively, if simulation speed is important an attempt could be made to incorporate het- 
erogeneous computing. This relates to using processors found on modern graphic cards to per- 
form highly parallel computation and may be suitable for improving the performance of numer- 
ical simulation. 

5.4 Visualisation of Network Evolution 

Being able to visualise and make sense of the evolutionary process is vital in to make use of 
output from NetEvo. Many algorithms exist to produce aesthetically pleasing visualisations 
of static graphs. However, these do not always extend well to situations where the topology is 
changing over time. Some force based methods have been proposed |9J, however, suffer stability 
issues for very large or highly connected graphs. Furthermore, with evolution of graphs often 
taking millions of iterations, any method must allow for quick interactive movement to points 
of interest without the need to view all intermediate steps. 
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